DEVICE INDEPENDENT VIDEO ENHANCEMENT SCRIPTING LANGUAGE 



Cross Reference to Related Applications 
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This application claims the benefit of United States provisional application serial 
number 60/227,930, filed August 25, 2000, entitled "SYSTEM AND METHOD FOR 
WEB BASED ENHANCED INTERACTIVE TELEVISION CONTENT PAGE 
LAYOUT", now United States patent application serial number 09/935,492, filed 
10 August 23, 2001 by Steve O. Markel. These applications are specifically incorporated 
herein by reference for all that they disclose and teach. 



Background of the Invention 



15 a. Field of the Invention 

The present invention relates to interactive and enhanced television and, more 
particularly, to a method and scripting language that provide enhanced television content 
-that may be employed across a plurality of platforms without re-editing. 



20 b. Description of the Background 

A television program may be accompanied by additional information employed to 
enhance the program or to provide viewer interaction. Enhancements have historically 
included closed captioning and multilingual support. Advances in networking, computer 
systems, and video production have increased the number and types of enhancements that 

25 may be provided with a program or advertisement. Enhancements may include stock 
updates, news stories, Internet links, weather forecasts, bulletins, statistics, trivia, and 
other information. For example, a football game may include icons allowing viewing of 
team players, player statistics, other statistics, trivia and other information such as 
upcoming games. Further, the advent of set-top-boxes, as maybe used in cable and 

30 satellite television systems, allows enhancement information to be presented in new 
ways, such as screen overlays and in windows, for example. 
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Enhanced television content may employ a combination of HTML (hypertext 
markup language), JavaScript, Java and other formats common to Internet page display. 
An enhanced display may comprise text, icons, graphics and images placed at locations 
on or in proximity to the television image. To produce an enhanced display, an author 
5 may create an enhancement file identifying each displayed object (such as text, icons, 
graphics and images), the location where each object is displayed and the time at which 
the object maybe displayed. Due to numerous differences between presentation 
platforms, such as set top boxes, satellite receivers, computers, or interactive televisions, 
for example, content providers have historically been required to select a specific 
10 platform in the development of an enhancement application. In order to provide support 
for each additional platform, the interactive content provider must introduce potentially 

Q significant modifications to the enhancement file, resulting in ongoing maintenance of 

p multiple enhancement files, and adding to the time and cost required producing enhanced 
page layouts for multiple platforms. 

UJ 15 m The creation and maintenance of multiple versions of enhancement files may also 

introduce unintended changes such that enhancements are not uniform across platforms. 

j»b * Therefore a new method and programming language for defining enhanced content that 

u j may be utilized across multiple platforms is needed. 

a 

H 20 Summary of the Invention 

The present invention overcomes the disadvantages and limitations of the prior art 
by providing a device independent scripting language that may be employed to produce a 
platform independent text based script enhancement file which then may be parsed to 
provide output of platform specific enhancement files. The scripting language comprises 

25 commands for selection of objects, specification of object attributes, and scheduling of 
object rendering. Objects may comprise images, text, television images, user input areas 
or other elements. Object attributes may comprise color, size, font type, z order, links, 
position, and other aspects that define the placement, usage and appearance of objects. 
Scheduling of object rendering may employ a trigger that defines a time in relation to a 

30 program, or objects may be rendered independent of the program, such as flashing text, 
for example. 
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The invention therefore may comprise a television enhancement programming 
language comprising: an object element that provides selection of an object, a property 
element that specifies an attribute for the object, a trigger element that specifies a time to 
render the object in relation to a program, and a television element that specifies a size 
5 and position at which a program may be displayed. 

The invention provides flexibility in the authoring of enhancements including 
usage of scripts, such as Javascript for example, to define and control enhancement 
presentation. A modify attributes command element allows objects to be moved, changed 
in color, re-sized or changed in z order, (allows objects to appear on-top or behind 
10 another element) or other attributes to be changed in a structured and efficient manner. A 
sync-data element provides retrieval of data from a broadcast stream, such as may be 
embedded in a vertical blanking interval, for example. 

The enhancement file, which may employ an XML format, contains a description 
of enhancements including object position, attributes, triggering, action and linkage. 
15 Triggering identifies an event timed relative to a program, such as a time or frame 

number for example, at which an action or script may be executed. Actions are collection 
of property modifications that may be performed together. Properties include the 
2 position, color and other attributes of a displayed object. Linkage may associate a file 

with an object such that a user may select a linked object to access websites, launch other 
20 applications, or to perform other tasks. 

Parsing the enhancement file may produce an output file targeted to a specific 
platform or set of platforms. A platform may comprise a set top box, interactive 
television or computer display. A file parsed for computer display may be employed for 
emulation and preview of enhancements and may contain functions for control of a 
25 browser media player. 

An enhancement file of XML format may be parsed using XSL (Extensible 
Stylesheet Language) scripts. In the present invention, an XML file with tags for 
administrative information, layout information, and trigger information is employed. The 
XML file may be parsed to produce an output file containing HTML and JavaScript code 
30 wherein the version of HTML and Javascript reflect the level of support provided by the 
target platform. Further, the output file may be formatted for a mode of enhancement 
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transport. In a first mode of transport, enhancements and triggers are supplied in 
conjunction with a video program. In a second transport mode, triggers and a locator, 
such as a URL, for example, are provided in conjunction with a video program and the 
platform employs the locator to access enhancement information. 
5 The invention may further comprise a system for developing television 

enhancements comprising a computer; a database; a web browser; and a parser operable 
to parse a platform independent enhancement file contained in the database and to 
produce an output that may be viewed employing the browser. 

Advantageously, the invention provides viewing and emulation of enhancement 
10 files employing a personal computer or similar equipment. This allows a team of 

developers and reviewers to be physically separated, and allows enhancement customers 
j«* (such as advertisers) to preview material by simply accessing a website. 

: 

% i 15 

W In the figures, 
a Figure 1 depicts 

f ^ top box products. 
UJ Figure 2 depicts 

□ 20 Figure 3 depicts 

Figure 4 depicts 
the present invention. 

Figure 5 depicts 
the content element. 

25 

Detailed Description of the Invention 



Description of the Figures 

html and image support for a group of commercially available set 

the environment of the present invention, 
an environment in which the present invention maybe utilized, 
child element groups of a root element of an enhancement file of 

a content element and child elements that may be contained in 



Enhanced television content comprises images, text, graphics and sounds that may 
be rendered in conjunction with a television program. Enhanced television content is 
30 typically presented using a combination of HTML, JavaScript, Java and other web 
technologies. The level of support for these technologies varies by the targeted 
presentation platform, including the combination of client hardware, operating system, 
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web browser and add-on software. A presentation platform may comprise a set top box, 
interactive television, computer, or other system operable to receive television signals 
and to process HTML and other code and to produce a display comprising a television 
image and enhancements. Capabilities vary depending the specific platform. Certain 
5 functions may or may not exist, or may be optimized on a given platform through the use 
of custom features. Variants include screen size and resolution, acceptable color 
combinations, graphics support, and version of HTML or JavaScript, for example. 
Providing concurrent support for the Internet or wireless handheld devices introduces 
additional requirements and dependencies. The present invention overcomes the 
10 difficulties of supporting multiple platforms, each having a specific set of capabilities, by 
: . employing a platform independent enhancement file that completely defines the 

0 enhancement assets, their location and other attributes, as well as the triggering 
□ information. The enhancement may be translated by parsing software to produce platform 

dependent files comprising HTML code and may contain JavaScript code tailored to the 
Ul 15 specific platform. The present invention also allows translation targeting a web browser 
9 " and a media player, providing emulation and preview of authored enhancements. 
f7 Figure 1 depicts HTML and image support for a group of commercially available 

Ly set top box products. Set top box models 100 provide HTML support 102 and image 
S support 104. HTML support 102 lists support for html 1.0, 2.0, and 3.2 versions. A 
= :3S 20 limitation of HTML is that some versions lack downward compatibility. For example, 

HTML versions 4 and higher do not support all the tags of HTML 3.2. Figure 1 serves to 
illustrate that an HTML based author for creating enhanced content would not be able to 
support a wide range of target platforms. 

Figure 2 illustrates the environment of the invention. Audio/video program 200 
25 may be enhanced with editor 202. Editor 202 may allow selection, positioning, and 

scheduling of the rendering of displayable or audible elements. Scheduling may employ 
specific times in the audio/video program, such as frame numbers, for example. Further, 
editor 202 may be employed to define an action to be performed when a scheduled time 
occurs. Such action allows display and control of the display of elements. For example, 
30 an action may cause an element to be displayed, or to be displayed in a new position, or 
to be displayed with new attributes (such as color), or to no longer be displayed. Editor 
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202 maybe similar to that disclosed in U.S. patent application number 60/227,930 titled 
'System and Method for Web Based Enhanced Interactive Television Content Page 
Layout". The result of editing is platform independent enhancement file 204. This file 
differs from HTML format files in that it contains scheduling and other control 
5 information. Parser 206 may be employed to parse platform independent enhancement 
file 204 to produce platform specific enhancements 208. 

Figure 3 depicts an environment in which the present invention maybe utilized. 
Environment 300 comprises head-end system 302 that transfers data across network 304 
to receivers 306 that provide signals to display units 308. Network 304 may comprise 
10 fiber optic, coaxial cable, terrestrial or satellite transmission, or combinations thereof, as 
i,^ is common to the art. Receivers 306 convert the incoming programming information into 

|g a format appropriate for input to display units 308, and thus for viewing by end users of 
the system. Receivers 306 may comprise set-top boxes, personal computers, interactive 
:! p» televisions, or other equipment operable to process television signals and other 
*j 15 information, such as control information and program guides, for example. Display units 
» 308 may comprise televisions, computer monitors, or other devices operable to display 

video images. One method of utilizing the present invention is to parse the platform 
independent enhancement file to produce an enhancement file compatible with receivers 
306. Enhancement information may then be broadcast in conjunction with a program, or 
receivers may be configured to retrieve enhancement information employing an Internet 
connection or other network that is not depicted. 

The present invention may comprise a file that includes enhancement types, 
enhancement attributes, scheduling, and other information. The file maybe of XML 
format and may have a document structure with elements organized into groups of child 
elements. Attachment A provides a specification of an embodiment of the present 
invention. Figure 4 depicts child element groups of a root element of an enhancement file 
of the present invention. Child elements 400 comprise head elements 402, library 
elements 404, content elements 406, and timeline elements 408. Head elements 402 may 
be employed to provide information such as document type, file name, library references, 
and other information such as author name and data created, for example. A meta 
element, similar to that of HTML, may be employed to describe a single piece of 
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information describing the enhancement file. Library elements 404 may specify the 
location of object templates, storage location for a working file, and other locations for 
items such as tools and specifications, for example. Content elements 404 may be 
employed to define the type, attributes and content of displayable objects. Content 
5 elements are described in greater detail in a later section of this disclosure. Timeline 
elements 408 may be employed to specify and time schedule rendering of enhancements 
in conjunction with a program. Timeline elements are described in greater detail in a later 
section. 

Figure 5 depicts a content element and child elements that may be contained in 
10 the content element. Content element structure 500 comprises content element 502, page 
element 504, object element 506, property element 508, action element 510, parameter 
Q element 512, modify-property element 514, action-call element 516, timed action-call 

.SSJl 

w 

PI element 518, script element 520, and a second page element 522. Content element 502 
'J| describes general attributes of all contained pages. Attributes associated with content 
U! 15 element 502 are described in Attachment A. A canvas attribute may describe the 

resolution in pixels of a single page of television content. A pixelAspect attribute may 
enable non-square pixels. A URL attribute may specify the location that a client-browser 
h j may use to access a page or pages. Page element 504 may contain a list of elements that 

.J5I5S, 

S define an object that may be displayed to the viewer, modifications to elements, timed- 
h i? 20 actions that specify when actions may occur, and may contain a script. Object element 

506 specifies an object that may be rendered in conjunction with a program. Objects may 
comprise visual entities such as images, text and graphics. Objects may also comprise 
executable entities such as scripts. Other objects may be added within the scope of the 
present invention. Such objects maybe employed to define or control additional program 
25 elements such as audio effects and sensory elements including motion and lighting, for 
example. Property element 508 defines an attribute of the object specified by object 
element 506. Attributes vary depending on object type and may include position, size, 
and color for example. A plurality of property elements may specify attributes for one 
object element. Attachment A defines property elements for object types such as image, 
30 text, field (that may be employed for user entry), tv (that may be employed to display a 
video program), and html. Action element 510 may list a set of modifications to element 
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properties by specifying modify-property elements. For example, an action element may 
be employed to change the color of an object, or to change the z-order of the object such 
that it appears on top or behind another object if so positioned. An action may reference 
another action by including an action-call element. Parameter element 512 may be 
employed to specify a value passed to an action. The parameter can be used as a value in 
a property modification that is contained in the action. For example, a parameter element 
may specify a new text string to be displayed in an existing text object. When a timed- 
action-call or trigger refers to the action, the caller may specify a value for each 
parameter. Modify property element 514 may indicate a change to a property element by 
an action. A modify property element may indicate the object on the page that is to be 
modified. The name indicates the property of the element to affect. The value indicates 
the new property value. Action-call element 516 may indicate a call to another action by 
an action. A value attribute indicates the action to call. A reference to an action maybe in 
the form of a function call with all parameters described in the definition of the action. 
Timed action-call element 518 is a call to an action or function in an included script that 
is timed relative to page invocation and not tied to the timeline of the broadcast video, as 
is a trigger element. Attributes for timed action-call element 518 are described in 
Attachment A. The attributes startTime, loopNTimes, and loophiterval may be employed 
to determine the starting point and frequency of the action specified by the value 
attribute. If loopNTimes is set to "0", the action specified in the value may be repeated 
until the viewer navigates to another page. Timed action-call elements may be employed 
to produce effects such as blinking text, for example. The startTime and loophiterval 
values may be specified in seconds. Script element 520 may be employed to enable the 
use of a scripting language, such as javaScript, to perform calculations. The target 
attribute is a space-separated list of strings that filter the use of the script only to listed 
platforms. If target is not specified or specified as "any", the script may be used on all 
platforms. The language attribute specifies the language of the script. The script can be 
included in the ITVML document by embedding the source code in the script element or 
the script may refer to an external file with the src attribute. A reference to an action may 
be in the form of a function call with any parameters described in the definition of the 
action. 
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An enhancement file produced using the scripting language of the present 
invention may be parsed employing an XSL parser to produce a platform dependent 
output file containing HTML and optionally containing javascript. XSL parsing 
information may be obtained from the following references. 

5 

Title: Professional XSL 
Authors: Kurt Cagle et al. 
Publisher: Wrox Press Inc; 
ISBN: 1861003579 

10 

% Title: XSL Companion, The 

Q Author: Neil Bradley 

\\ Publisher: Addison-Wesley Pub Co; 

* ISBN: 0201674874 

%l 15 

U The foregoing description provides a platform independent enhancement that may 

|"j be parsed to produce platform dependent files without needing to change the authored 
O enhancements, saving time and money and providing a uniformity of enhancement across 
multiple platforms. The attached specification (Attachment A) employs a document 
20 definition to define both a language and a file format. The 'element' element of the 
attached specification has been described as an 'object' element in the foregoing 
description. An XML file format has been employed in the described embodiment. Other 
formats, both public and proprietary, may be employed to describe enhancements and 
attributes of the elements comprising enhancements. Enhancement output files allow 
25 enhancement of a television broadcast that may employ various methods of delivering 
enhancement data. A first method transfers enhancement data as part of the broadcast. A 
second method transfers a trigger and locator with the broadcast, and the set top box, or 
other platform, employs the locator to access enhancement information. The second 
method of transfer may further comprise receiving information identifying the type of 
30 platform requesting enhancement data (when the platform accesses the locator), and 

providing enhancement information suited to the requesting platform. A new or modified 
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parser may be employed to support new platforms, or new versions of platforms. The 
new or modified parser then may be applied to a plurality of source enhancement files 
that need not be modified. In this manner, the present invention provides costs savings in 
supporting new platforms or new versions of platforms. 

The foregoing description of the invention has been presented for purposes of 
illustration and description. It is not intended to be exhaustive or to limit the invention to 
the precise form disclosed, and other modifications and variations may be possible in 
light in the above teachings. The embodiment was chosen and described in order to best 
explain the principles of the invention and its practical application to thereby enable 
others skilled in the art to best utilize the invention in various embodiments and various 
modifications as are suited to the particular use contemplated. It is intended that the 
appended claims be construed to include other alternative embodiments of the invention 
except insofar as limited by the prior art. 
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